Papers with Knowledge Selection
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models outperform information retrieval techniques for downstream knowledge-intensive tasks when being prompted to generate world knowledge. |
| Approach: | They propose a COmpreheNsive kNowledge Evaluation framework to evaluate generated knowledge from six important perspectives . they conduct extensive empirical analysis of generated knowledge on two widely studied knowledge-intensive tasks . |
| Outcome: | The proposed framework evaluates generated knowledge from six important perspectives on two knowledge-intensive tasks. |